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DETAILED ACTION 

Claim Rejections - 35 USC §112 

1 . The following is a quotation of the second paragraph of 35 U.S.C. 1 1 2: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

2. Claims 4, 11-16, 23 and 26-28 are rejected under 35 U.S.C. 112, second 
paragraph, as being indefinite for failing to particularly point out and distinctly claim the 
subject matter which applicant regards as the invention. 

Regarding claims 4 and 14, Line 1, the phrases "the parameter" in claim 4, and 
"the vehicle" in claims 4 and 14 seem to be referring to a previously cited parameter, 
platfomn and vehicle which does not appear in the claims; 

Regarding claim 1 1 , Lines 6-7, the citation, compensating of the map being based 
on differences between ttie assumed ground plane and the assumed ground plane is 
ambiguous and therefore indefinite for the examiner to make a proper examination of 
the claim under 37 CFR 1 .104; 

Regarding claim 23, the phrase "the computer readable medium" lacks 
antecedent bases because it has not previously been defined; 

Regarding claim 26, Line 5, the phrase "the original stereo images" seems to be 
referring to a previously cited stereo image which does not appear in the claim; 

Regarding claim 28, the phrase "the target" seems to be referring to previously 
cited target which does not appear in the claim. 

Therefore, the above phrases are vague and confusing because it is unclear what 
feature or element is further limited by this language. 
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Claims 12-16 and 27 variously depend from a indefinite base claim and are thus 
themselves indefinite. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an International application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

4. Claims 1 , 2. 6, 21 . 26, 27 and 30 are rejected under 35 U.S.C. 1 02(e) as being 
anticipated by Brumitt (US 5,563,988). 

Brumitt teaches the limitation of claim 1 , a method of performing vision 
processing comprising: producing a depth map of a scene proximate a platform, 
wherein the depth map is based on an assumed ground plane (Column 7, Line 66 
through Column 8, Line 5, wherein the range images are the depth map images and are 
generated based on a scene which includes an assumed ground plane as will be further 
discussed in relation to actual ground identifying teaching); identifying an actual plane 
using the depth map (Column 11, Line 59, through Column 12, Line 4, wherein based 
on the original depth image of the scene, the pixel values of the boundaries of the scene 
which are considered to be part of the assumed ground plane are considered for 
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defining the actual ground plane); and compensating the depth map for differences 
between the assumed ground plane and the actual ground plane (Column 12, Lines 10- 
17. wherein the pixels location on the map are rotation for roll and the pitch of the 
camera as part of the compensation for differences between the originally assumed 
ground plane and the newly generated actual ground plane); 

Brumitt teaches limitation of claim 2, method further including the step of 
comparing the depth map to a plurality of templates to identifying a match between the 
depth map and at least one template (Column 1 1 , Lines 15-21 . wherein the previously 
characterized objects or persons are the templates which the system perfomns the 
matching of the depth image objects with); 

Brumitt teaches limitation of claim 6, accessing at least from a database comprising 
a plurality of templates (Column 1 1 , Lines 15-21, wherein having a database for for 
retrieving comparable data); 

Brumitt teaches the computer readable medium of claim 21 storing a vision system 
program corresponding to method of claim 1 above (Column 5, Lines 10-12); 

Brumitt teaches limitation of claim 26 conresponding to the method of claim 1 above 
utilizing stereo images (Column 8, Lines 1-5); 

Bmmitt teaches limitation of claim 27, the technique of correction Is a vertical 
translation of the original stereo images (Column 12, Lines 10-17, where x, y, z 
positions are corrected for by translation in y or vertical direction); 
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Brumitt teaches limitation of computer readable medium of claim 30 storing a 
vision system program that controls a computer to perform the steps of the 
conresponding method claim 26 (Column 5, Lines 10-12). 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which fomris the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 2-4, 6 and 7 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Bmmitt in view of Gokturk et al. (US 200301699060). 

Brumitt teaclies number of limitation of the claims including comparing of objects 
to a pre-characterized objects being templates for identification of newly generated 
objects however, Brumitt fails to specifically teach having a particular database with 
plurality of templates stored therein related to detected objects. Gokturk teaches, 
limitation of claim 2, further step of comparing the depth map to a plurality of templates 
to identifying a match between the depth map and at least one template (Paragraph 
131, Lines 1-5, wherein depth maps images of a face (Paragraph 130) is being matched 
to the templates in a database); 

Gokturk teaches limitation of claim 3, method further including a step of adjusting 
a parameter of the platform in response to a match (Paragraph 152, Lines 5-7, where 
the operation of the airbag onboard is adjusted based on the occupant); 



Application/Control Number: 1 0/81 3,768 Page 6 

Art Unit: 2621 

Gokturk teaches limitation of claim 4. wherein the parameter is selected from an 
airbag (Paragraph 152, Lines 5-7); 

Gokturk teaches limitation of claim 6, accessing at least one template from a 
database comprising a plurality of templates (Paragraph 132, 1-3, wherein a database 
of templates or faces is provided for accessing; 

Gorturk teaches limitation of claim 7, the plurality of templates represent objects at 
varying positions and poses relative to the platfomn (Paragraph 105, Lines 1-8. wherein 
translational and pose data is incorporated into modeling process). 

It would have been obvious to an ordinary skilled person in the art to utilize 
Brumitts characterization process of the regions based on the depth image of the scene 
and storing them for later use (Column 1 1 , Lines 11-21) with Gorkturks system 
because, the characterization of the scene of an interior of a vehicle and identifying the 
person entering the vehicle by matching technique to the previously stored scene 
images requires less processing than recognition and classification of Gorkturks and 
this utility is further helpful in determining airbag deployment process based on the 
previously stored object poses (Paragraph 54). 

7. Claims 8, 9, 17 and 29 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Brumitt in view of Trajkovic et al. (US 200301 12132). 

Regarding claims 8 and 9, Brumitt teaches number of limitations of the claims 
however, Brumitt fail to specifically teach at least one template in the plurality of 
templates is a model of a vehicle and/or pedestrian or the collision avoidance system of 
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the claims. Trajkovic teaches templates generated for detecting of pedestrians and 
vehicles (Paragraph 30, Lines 6-16). It would have been obvious to an ordinary skilled 
person in the art to utilize identifying of objects based on segmented regions in 
reference to a ground plane of a scene of Bnjmitts system with Trajkovic et al. in order 
to match vehicles or pedestrians to specific regions and not the whole scene. 

Brumitt teaches limitation of claims 17 and 29 substantially, a collision avoidance 
system comprising: a collision detection system comprising (there are no weights given 
to either collision avoidance or detection because they are not referred or recited in the 
body of the claim and therefore are only considered as an intended use): a stereo 
image preprocessor for preprocessing said imagery (Column 8, Lines 1-5, process 
action 300 is the preprocessor); a map generator for producing from said preprocessed 
imagery a map referenced to an assumed ground plane (Column 8, Lines 1-8, wherein 
range images being the depth map images are generated with the ground area being 
part of the scene in the images); and a target processor for determining the actual 
ground plane from said map (Column 1 1 , Line 59 through Column 12, Line 4, where a 
actual ground plane is defined based on the assumed ground boundary pixel analysis of 
step 31 2 of figure 3 for further target or object processing step 31 6); 

However Brumitt does not specifically teach a platform; a stereo camera pair for 
producing imagery of a scene of the claims. Trajkovic teaches stereo cameras for 
producing a stereo image (Paragraph 36, Lines 1-16). It would have been obvious to 
an ordinary skilled person in the art to utilize pair of cameras of Trajkovics system in 
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order to account for curvatures and non-linearities of the optics of a camera (Paragraph 
34. Lines 12-17). 

Allowable Subject Matter 

8. Claims 5, 10, 18-20 and 22 are objected to as being dependent upon a rejected 
base claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any Intervening claims. The following is a statement of 
reasons for the indication of allowable subject matter: the prior art of record does not 
teach depth Image template matching based on criteria of claim 5, removing the actual 
ground from the map image of claims 10 and 18; collision detector estimating the size of 
the detected potential threat of claims 19 and 22 combined with other features and 
elements of the claims. 

9. Claims 11-16 would be allowable if rewritten or amended to overcome the 
rejection(s) under 35 U.S.C. 112, 2nd paragraph, set forth in this Office action. The 
following is a statement of reasons for the indication of allowable subject matter: the 
prior art of record does not teach removing the actual ground from the map image of 
claim 1 1 combined with other features and elements of the claim. 

1 0. Claims 23 and 28 would be allowable if rewritten to overcome the rejection(s) 
under 35 U.S.C. 112, 2nd paragraph, set forth in this Office action and to include all of 
the limitations of the base claim and any intervening claims. The following is a 
statement of reasons for the indication of allowable subject matter: the prior art of record 
does not teach removing the actual ground from the map image of claim 23 and refining 
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the estimated lieight and with of a target, combined with other features and elements of 
the claims. 

1 1 . The following is an examiner's statement of reasons for allowance: claims 24 and 
25 are allowed because, the prior art of record specifically Brumitt, Gorkturk et al. and 
Trajkovic et al. by themselves or together do not teach removing the ground plane from 
the map combined with other features and elements of the claims. 

Other prior art cited 

12. Prior art of record cited and not relied upon is considered pertinent to 
applicant's disclosure. 

The US Patent Application 20040223630; US Patent Application 200301 39865; 
US Patent Application 20030048930; US Patent Application 20020183906; US Patent 
6,421.463; US Patent 6,169.516; US Patent 5.745,126; US Patent 5,581,638; US 
Patent 5.563.988; US Patent 5,109,425 and US Patent 4,695,959 variously teach object 
detection, tracking and collision avoidance related to applicant's Invention as claimed. 

Contact information 

1 3. Any Inquiry concerning this communication or earlier communications from the 
examiner should be directed to Shervin Nakhjavan whose telephone number is (703) 
306-5916. The examiner can nomally be reached on Monday through Friday from 8:00 
am to 5:30 pm. If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Bhavesh Mehta, can be reached at (703)308-5246. 

Any response to this action should be mailed to: 

Assistant Commissioner for Patents 
Washington, DC 20231 
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Or faxed to: 

(703) 872-9306 for formal communications, please marl( "EXPEDITED 
PROCEDURE" 
or: 

for informal or draft communications; please label "PROPOSED" or 
"DRAFT". 



Hand delivered responses should be brought to Crystal Park 2, 2121 Crystal 
drive, Arlington, VA, sixth floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Tech center 2700 customer senrice office (703) 306-0377. 



Group Art Unit 2621 
February 14, 2005. 



Shervin Nakhjavan 
Patent Examiner 




